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(54) General purpose distributed operating room control system 



(57) The present invention pertains to control sys- 
tems and provides a run time configurable control sys- 
tem for selecting and operating one of a plurality of 
operating room devices from a single input source, the 
system comprising a master controller having a voice 
control interface and means for routing control signals. 
The system additionally may include a plurality of slave 



controllers to provide expandability of the system. Also, 
the system includes output means for generating mes- 
sages to the user relating to the status of the control 
system in general and to the status of devices con- 
nected thereto. 
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Description 

BACKGROUND OF THE INVENTION 

REFERNCE TO PARENT APPLICATION 

[0001] The presently filed application is a continua- 
tion-in-part application of a U.S Patent Application enti- 
tled GENERAL PURPOSE DISTRIBUTED 
OPERATING ROOM CONTROL SYSTEM, which was 
filed with the U.S. Patent and Trademark Office on 
August 6, 1996 and is currently pending with serial 
number 08/693,352. 

1. FIELD OF THE INVENTION 
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urable amount of time and as such, extends the time 
that a patient is under anesthesia, which may add to the 
danger of a procedure. 

[0006] Therefore, what is needed in the art is a gen- 
eral purpose platform for controlling a plurality of 
devices such that devices can be added or subtracted 
from the platform depending upon the environment into 
which the platform, also known as a control system is 
introduced. The system may additionally be automati- 
cally configured at start up. Additionally, what is needed 
is a system and method for selecting and operating one 
of the plurality of the attached devices, namely operat- 
ing room devices. It is to the solution of the hereinabove 
mentioned problems to which the present invention is 
directed. 



[0002] The present invention generally relates to 
control systems. More particularly, the present invention 
relates to a control system and apparatus that allows 
multiple surgical devices to be controlled from one or 
more input devices. Even more particularly, the present 
invention provides a run-time configurable control sys- 
tem allowing operating room component connectivity 
and control. 

2. DESCRIPTION OF RELATED ART 

[0003] Many surgical procedures are performed 
with multiple instruments. For example, some lapro- 
scopic procedures are performed utilizing a robotic arm 
system produced by Computer Motion, Inc. of Goleta, 
California to hold and move an endoscope. The surgeon 
may also use a laser to cut tissue, an electrocautery 
device to cauterize the tissue, and lights to illuminate 
the surgical site. 

[0004] Each instrument has a unique control inter- 
face for its operation. Therefore, the surgeon must inde- 
pendently operate each device. For example, the 
surgeon must utilize a foot pedal to control the electro- 
cautery device, a separate foot pedal to operate the 
robotic arm, and yet another interface to operate the 
laser. 

[0005] Operating multiple devices may distract the 
surgeon, thereby reducing the efficiency of performing 
various procedures. Additionally, it is cumbersome uti- 
lizing various devices where each device has a sepa- 
rate user interface. If a new device is introduced into the 
operating room environment, the doctor must learn how 
to use the new user interface. Additionally, there is cur- 
rently no known run time configurable system for oper- 
ating more than one specific operating room device via 
voice control. As such, if there are two or more devices 
in the operating room that are voice controlled, the doc- 
tor has to remove the microphone used for one device 
and replace it with the microphone for the other device. 
Obviously, this creates many problems associated with 
productivity. Additionally, the necessity of actually 
switching between many user interfaces takes a meas- 



SUMMARY OF THE INVENTION 

[0007] In accordance with the present invention 
20 there is provided a control system for selecting from and 
controlling a plurality of devices in an operating room, 
the control system comprising: 

a master controller, the master controller compris- 
es ing: 

a) means for receiving selection commands 
from a user wherein each selection command 
is associated with one specific device in electri- 

30 cal communication with the master controller; 

b) means for receiving control commands from 
a user; 

35 c) means for converting selection commands 

and control commands into corresponding 
selection signals and control signals; 

d) means for routing control signals to a device 
40 specified by a selection command received by 

the means for receiving selection commands. 

[0008] In accordance with a first aspect of the 
present invention, there is provided a master controller 

45 for selecting and controlling a plurality of devices. Each 
of the plurality of devices to be controlled are in electri- 
cal communication or in wireless communication with 
the master controller, either directly or via a slave con- 
troller which will be discussed in more detail hereinbe- 

50 low with respect to the second aspect of the present 
invention. 

[0009] The master controller includes means for 
receiving selection commands issued by a user. The 
selection commands available to the user are based 
55 upon the devices in electrical communication with the 
master controller. The master controller may recognize 
those devices that are in electrical communication 
therewith upon startup of the master controller. This will 
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be described in detail in the description of the preferred 
embodiment. Each device in electrical communication 
with the master controller is represented by a corre- 
spondingly available selection command. 
[0010] The master controller additionally includes 
means for receiving control commands from the user. 
Both the means for receiving selection commands and 
the means for receiving control commands from a user 
may be included in a voice control interface (VCI) for 
receiving voice commands. The system may addition- 
ally employ a foot pedal, a hand held device, or some 
other device which receives selection or control com- 
mands or inputs indicative of such commands from a 
user. The VCI provides signals indicative of a user's 
selection of a specific device and signals indicative of 
control commands the user wishes to supply to the 
device specified by a specific selection command. 
These are known, respectively, as selection signals and 
control signals. If the user is using a foot pedal, hand 
controller or some other input device, the VCI is not uti- 
lized as the inputs are already in the form of electrical 
signals as opposed to voice input. Alternatively, a com- 
bination of devices may be used to receive selection 
and control commands and to provide selection and 
control signals indicative of such commands. 
[0011] The master controller additionally includes 
means for routing control signals to a device specified 
by a selection command. For example, if the user wants 
to operate the laser, a device used in many surgeries 
and contemplated as being included as one of the 
devices that may be operated via the control system of 
the present invention, then the user may issue a selec- 
tion command indicating such, i.e. speak the word 
"laser" or the words "select laser". As such, the name of 
the device may serve as the selection command, or the 
selection command may be the combination of two or 
more words. 

[0012] Subsequent to receiving a selection com- 
mand from the user and converting the selection com- 
mand into a selection signal, if necessary, the master 
controller then routes control commands, or control sig- 
nals for a selected device indicative of control com- 
mands received from the user to the device specified by 
the preceding selection command. In this exemplary 
instance, control signals would be routed to the laser. 
Preferred structures for both selection commands and 
control commands are disclosed herein in the detailed 
description of the preferred embodiment of the present 
invention. 

[0013] Additionally, a controller may include means 
for ensuring that control signals indicative of control 
commands issued subsequent to the receipt of a selec- 
tion command are, in fact, valid control signals. This is 
accomplished via a database of valid control commands 
and grammars that are either prestored in the master, or 
are prestored in a slave prior to or at system startup 
which is described he rein below. 

[0014] A second aspect of the present invention is 



at least one slave electrically connected to the master 
controller. Each slave controller connected to the mas- 
ter controller operates similarly to the master controller 
tor specific devices electrically connected thereto; addi- 

5 tionally, the slave controllers may receive control com- 
mands directly from the user if they are to be used as a 
stand alone unit. However, if they are utilized as slaves 
then control commands are received at the master con- 
troller and converted into control signals and transmit- 

io ted from the master controller to the slave controller that 
has the device specified by the last selection command 
received by the master controller connected thereto. 
This allows the control system of the present invention 
to operate with a plurality of different devices without the 

is master controller requiring any knowledge of the 
devices connected to the slave controllers prior to star- 
tup of the control system. 

[0015] The slave controllers are connected to the 
master controller just like any other device; however, 

20 each slave controller provides the master controller 
information relating to the specific devices that are con- 
nected thereto, so the master controller, generally at 
startup, is provided information as to exactly what 
devices are connected to the system. The selection 

25 commands available to the user include all devices con- 
nected to each of the slave controllers as well as the 
devices directly connected to the master controller. By 
providing an open architecture such as that generally 
set out hereinabove, and more particularly, a master 

30 controller and slave controllers, various devices may be 
controlled from a single controller, or a plurality of con- 
trollers, such that a doctor utilizing the control system 
will not have to switch between different control systems 
or interfaces, or at a minimum will have an easier inter- 

35 face to control each of the devices. It is additionally envi- 
sioned that the main means for selecting and controlling 
each of the devices will be a voice recognition system 
which will be described in detail hereinbelow. 
[0016] Also, the control system may include audio 

40 and video outputs which are capable of alerting the user 
to errors in selecting, or controlling specific devices. The 
audio and video outputs may additionally be used to 
alert the user to problems with each of the specific 
devices as well as to provide status notices as to which 

45 device (s) are available, which devices are active, as well 
as a host of other device operation information which 
will be discussed further hereinbelow. 
[0017] For a more complete understanding of the 
present invention, reference is made to the following 

50 detailed description and accompanying drawings. In the 
drawings, like reference characters refer to like parts, in 
which: 

BRIEF DESCRIPTION OF THE DRAWINGS 

55 

[0018] 

Figure 1 is a block diagram of a master controller in 
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electrical communication with both stave controllers 
and operating room devices in accordance with the 
present invention; 

Figure 2 is a block diagram of the voice control 
interface in accordance with the present invention; 
Figure 3 is a schematic of the voice control interface 
card in accordance with the present invention; 
Figure 4 is a schematic diagram of a master con- 
troller in accordance with a the present invention; 
Figure 5 is an exemplary tree diagram of a grammar 
for operating a device in accordance with the 
present invention. 

nrsCRIPTION OF THE PREFFRRED EMBODI- 
MENTS 



[0019] In accordance with the present invention, 
there is shown in Figure 1 an operating room control 
system, generally at 10, in accordance with the present 
invention. The operating room control system, or control 
system 10, generally comprises a master controller 12, 
which is preferably attached to at least one slave con- 
troller 14. Although the exemplary preferred embodi- 
ment is shown as having both a master controller 12 
and at least one slave controller 14 in electrical commu- 
nication therewith, the control system 10 may be imple- 
mented with only a master controller 12 as will be 
described hereinbelow. 

[0020] The master controller 12 is electrically con- 
nected to and in electrical communication with a plural- 
ity of devices 16 via a plurality of communication ports 
46. Alternatively, the master controller 12 may be con- 
nected to any slave or specific medical device via wire- 
less communications systems such as IR or RF signal 
transmitters and receivers on each of the master 12, 
slaves 14, and devices 16. Some of these devices 16 
may be at least one slave controller 14 the operation of 
which will be described hereinbelow. Other devices that 
are intended to be electrically connected to the master 
controller 1 2, either directly or via the at least one slave 
controller 14 include devices that are commonly found 
in an operating room environment. 
[0021] For purposes of non-limiting example, 
directly connected to the master controller 12 in Figure 
1 is an electrocautery device 18. A robotic arm 20 for 
holding and manipulating art endoscope, such as that 
produced by Computer Motion of Goleta, California and 
marketed under the tradename AESOP is electrically 
connected with the master controller 1 2 via one of the at 
least one slave controllers 14. Also in electrical commu- 
nication with the master controller 1 2 via a slave control- 
ler is an operating room table 22, an insufflator 24. and 
an operating room lighting system 26. It is envisioned 
that any electrically controlled device utilized in an oper- 
ating room environment may be attached to the master 
controller 12 either directly or via one of the at least one 
slave controllers 14. 

[0022] The master controller 12 is configured to 



provide a main user interface for each of the devices 
electrically connected thereto. As such, a doctor can 
manipulate the operating room environment in a simpler 
and more direct fashion. Currently, each device in an 
5 operating room includes a separate interface. The prox- 
imity of the doctor to each interface requires a substan- 
tial amount of movement either on the part of the doctor 
or a nurse to effectuate changes required by the doctor 
during a medical procedure. 
io [0023] For example, if the doctor needs the lights 
dimmed slightly, then a nurse currently has to approach 
the lighting system of the operating room and dim the 
lights. It would be highly advantageous for the doctor to 
be able to control such changes directly to keep move- 
rs ment in the operating room to a minimum to increase 
sterility, and because direct control by the doctor of the 
operating room environment and the devices he or she 
is using ensures the highest degree of safety with the 
smallest amount of error due to miscommunication 
20 between people in the operating room. Minimization of 
movement in an operating room environment is addi- 
tionally advantageous to reduce the risk of contamina- 
tion of specific sterile instruments, as well as the 
operative site itself. 
25 [0024] To effectuate such a control system 10, the 
master controller 1 2 generally comprises a voice control 
interface (VCI) 32. The VCI 32 includes means 28 for 
receiving selection commands from a user wherein 
each selection command is associated with one specific 
30 device in electrical communication with the master con- 
troller 12. This is accomplished by providing the master 
controller 12 a list of the devices that are in electrical 
communication therewith upon start-up of the control 
system 1 0. The process and hardware for providing the 
35 master controller 12 with such a list will be described 
hereinbelow. 

[0025] As shown in Figure 2, The VCI 32 addition- 
ally comprises means 30 for receiving control com- 
mands from a user. In the preferred embodiment, both 
ao the means 28 for receiving selection commands and the 
means 30 for receiving control commands may coexist 
in the VCI 32 as a microphone 34, for receiving the 
actual speech of the user, an analog to digital converter 
36 for converting the analog speech into a digital repre- 
45 sentation thereof, a feature extractor 38 for converting 
the digital representation to a digital representation that 
is suited for decoding, and a decoder 40 for comparing 
the features of the transformed digital representation of 
the speech to a set of presaved user-models 41 to 
so determine whether the speech received at the micro- 
phone 34 was a selection command, a control com- 
mand, or some other speech to be ignored by the 
master controller 12. Such "other speech" would include 
extraneous noise, speech between the doctor and 
55 another person in the operating suite, as well as speech 
of other people in the operating suite in general. 
[0026] Feature extractors, such as the one 
employed in the present invention, are well known in the 
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art of voice recognition. Feature vectors are preferably 
generated by the feature extractor 38 utilizing tech- 
niques such as Mel-Cepstrum, or linear prediction. It is 
to be appreciated that such techniques are well-known 
and are employed in the feature extractor 38 to develop 
feature vectors that represent speech received by the 
VCl 32. 

[0027] Additionally, voice software is also available 
that provides extractors and decoders such as the ones 
set out in the present application. As such, although a 
specific implementation is presented herein for voice 
recognition, it may be carried out by the inclusion of a 
p re-made voice recognition system that is purchased 
from a vendor such as Creative labs under the trade- 
name VOICE BLASTER, Dragon Dictate produced by 
Dragon Systems, or VOICE PAD produced by Kurzweil 
Al of Massachusetts, each of these companies produce 
front-end voice recognition systems. 
[0028] The decoder 40 utilizes the information pro- 
duced by the feature extractor 38, by matching the 
stored user models 41 to the output of the feature 
extractor 38 utilizing a well-known method, such as a 
Hidden Markov Modeling. One Hidden Markov Model 
(HMM) is created for each phoneme. The HMMs are 
trained to identify their respective phonemes given the 
Mel-Cepstrum output from the feature extractor 38. The 
use of Hidden Markov Models for voice recognition is 
generally well known. 

[0029] The stored user models 41 used by the 
decoder 40 may be placed in a memory 44 associated 
with the VCl itself. As depicted in Figure 3, such a mem- 
ory 44 may be incorporated onto a VCl board 46 as an 
EPROM, a PROM or some other programmable mem- 
ory storage device. However, it is preferable to store the 
models on a transportable memory device 45, such as 
a disk, transportable storage medium or the like. It is 
even more preferable that the transportable memory 
device be a PCMCIA format card 48 as data transfer 
times are reduced and the ruggedness of the system is 
increased. PCMCIA format cards retain data better than 
floppy disks. Additionally, the configuration of currently 
produced PCMCIA cards allows for additional program 
data to be stored on the PCMCIA format card and 
downloaded into the master controller 12 when system 
changes are made (i.e. upgrades to the system soft- 
ware etc.). Therefore, the use of such a PCMCIA form 
factor card is preferable in the control system 1 0 of the 
present invention. 

[0030] Figure 3 depicts, in more detail, the VCl 32. 
Once the user's speech has been digitized at the A/D 
converter 36, it is fed to the feature extractor 38. The 
feature extractor 38 functions as set out hereinabove. In 
more detail, the feature extractor 38 converts the digi- 
tized signal into a representation that is suitable for 
decoding (e.g. Mel-Cepstrum). This representation is 
then passed to the decoder 40 which compares the rep- 
resentations produced at the feature extractor 38 to the 
models stored on a memory 44 which contains the user 



models 41 . The memory 44 may be supplied the models 
41 via a downloading process from the transportable 
memory device 45. The models stored in the memory 
44 constitute a lexicon, which is the entire set of valid 
5 pronunciations, or al) of the valid words that the master 
12 is to recognize. Because the lexicon is stored on a 
transportable data storage medium 41 , the lexicon may 
be added to or subtracted from depending upon the 
devices that are to be connected to the master control- 
to ler 12. In this fashion, if new equipment is purchased at 
a date subsequent to the purchase of the master con- 
troller 12, then new words may be added to the lexicon 
through a well-known data acquisition technique, 
wherein the user speaks the words that are to be added 
? 5 to the lexicon and they are used to update the user mod- 
els 41 on the transportable memory 45. 
[0031] Most preferable to the implementation of the 
present system 1 0, there is provided one master con- 
troller 12 and at least one slave 14 controller. In such a 
20 configuration, which will be discussed in more detail 
hereinbelow, once the master controller or master 12 
receives a selection command, all speech received at 
the VCl 32 of the master 12 that is not a new selection 
command is fed to the feature extractor of the appropri- 
25 ately attached slave 1 4. In this way, a plurality of devices 
may be attached to several different controllers and the 
lexicon stored in each controller does not have to be 
downloaded into the master 12. The master 12 only 
contains the lexicon of all the devices that may be con- 
so nected to the system 1 0 as well as the lexicon for the 
commands of those devices that are directly attached to 
the master 1 2 as opposed to being attached to a slave 
14 which is, in turn, attached to the master 12. 
[0032] All the other controllers, which for purposes 
35 herein, are referred to as slaves 14, include the lexicon 
for the devices that are directly connected thereto. For 
example, in Figure 1, one slave includes the lexicon for 
the control commands and the select commands for a 
robotic arm and an operating table. This way, that con- 
40 troller can have a microphone plugged into the VCl 
which is included in the unit and it may serve as a solo 
unit. Or, depending upon the configuration of the control 
system 10, it may actually server as a master The 
entire system 10 is configurable at startup and as such 
45 is expandable. Every controller preferably includes a 
VCl. 

[0033] The decoder 40 additionally contains a lan- 
guage model. This term is well-known on the art and will 
be explained further hereinbelow. In essence, certain 

so words may be validly said in certain orders. The lan- 
guage model is implemented by developing a network 
representing all the valid possibilities of word combina- 
tions and decoding the extracted vectors along each 
path in the network. Whichever path has the highest 

55 probability of matching the incoming speech, the infor- 
mation associated with that path is selected by the 
decoder 40. It is to additionally be appreciated that to 
carry out the present invention, a silence path is availa- 
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ble and an unrecognized command path is provided as 
well. As such, even though a user speaks, if valid com- 
mands are not given, the system 10 will not respond. 
[0034] Figure 5 sets out one exemplary language 
model for the proper operation of the robotic arm 20. 
Such language models are developed for each device in 
electrical communication with the master controller 12. 
Once again, a device may be in wireless communication 
with the master controller 12. It is preferable to store the 
language models for each device in their respective 
controller. For example, if a device is directly connected 
to a slave 14 then the control language model (that lan- 
guage model containing the language used to control 
the device) for the device is stored in the slave VCI. If 
the device is directly connected to the master 12 then 
the control language model is included in the VCI of the 
master 12. It is to be appreciated that the select lan- 
guage model must be stored in the master 12 for all the 
possible devices that may be directly connected to the 
master 12 as opposed to being connected to a slave. As 
such, depending upon what devices are connected to 
the system at any given time, a user may select from 
any of the connected devices. If a device is not con- 
nected, the system will recognize this upon startup and 
will not attempt to access the device as it is not there. 
This will be discussed in more detail hereinbelow. 
[0035] If a device is connected directly to the mas- 
ter controller 12, then it is preferable to store the lan- 
guage model for controlling the device either in the VCI 
itself, or in the transportable memory 45. The advan- 
tages of this configuration are set out hereinbelow with 
respect to the startup of the control system 1 0. 
[0036] If a select command is given for a device that 
is directly connected to the master 12, then the informa- 
tion is passed to the decoder in the master 12 and the 
decoder 40 generates a packet 52 of information. The 
packet includes the address of the device to be oper- 
ated, a code representing the specific operation, and a 
checksum to ensure that as the packet 52 is transferred 
over various busses, the data does not become cor- 
rupted. Such information packaging is well-known 
although the specific package set out hereinabove has 
heretofore not been utilized to control one of a plurality 
of medical devices. Data checking using a checksum is 
also well-known in the art. 

[0037] The decoder 40, upon decoding a valid 
selection command, activates the address of the device 
which has been stored in a lookup table and is related to 
the device. This is accomplished as follows. At startup 
every controller, whether the master 12 or a slave 14 
knows the addresses of its communication ports. It 
sends a query to each communication port to see if a 
device is connected thereto. If so, an adapter connected 
to the device specifies the name of the device and an 
indication that it is functioning properly. Such adapters 
are well known in the electrical arts and as such will not 
be further discussed herein. Every slave controller 
establishes a lookup table of addresses and associated 



device codes or names. The device codes or names are 
transmitted to the master 12 which includes all the 
devices and the corresponding address of the port to 
which the associated slave controller is connected to 
5 the master 12. 

[0038] The addresses of all devices available are 
initially stored in a memory associated with the VCI 
such that a multiplexer may be used to activate a spe- 
cific address or make that address accessible. In this 
io fashion, once the master 12 receives a valid selection 
command, which it is able to identify, it then routes all 
the control commands to the VCI of the appropriate 
slave controller in the case where the device selected is 
connected to a slave controller. If the selected device is 
is connected directly to the master 12 then the control 
commands are fed through the decoder 40 of the mas- 
ter 12 and the control information packet is produced 
and sent to the device via the central processor 44 of 
the master 12. In this fashion, the VCI of a slave is fed 
20 control signals and processes those signals as though 
they were received from the A/D converter, which is 
where the input to the slave is routed. Every slave can 
be attached to one master, and that master, can, in turn 
be attached to another master, thus providing a daisy- 
25 chain of slaves all of which are connected to one master 
having a microphone attached thereto. 
[0039] In addition to the VCI 32, the master control- 
ler 12 comprises means 42 for routing control signals to 
a device specified by a selection command received at 
30 the VCI 32. Figure 4 depicts the master controller 12 
having one slave controller 14 and two medical devices 
in electrical communication therewith. The master con- 
troller includes the VCI 32 as well as the means 42 for 
routing control signals. Once the speech has been 
35 extracted and decoded into either a selection com- 
mand, or a control command, the specific command is 
transmitted to the Central Processor 44 of the master 
controller 12. 

[0040] In the preferred embodiment, the means 42 
40 for routing control signals is incorporated into the central 
processor 44 of the master controller 12. The means 42 
for routing is essentially an addressable multiplexer and 
has a memory of the addresses for each device and 
their associated one of the plurality of communication 
45 ports 46 to which they are connected. If the addresses 
are stored in the decoder 40, then the central processor 
44 will be in communication with that memory. 
[0041] The means 42 for routing, takes the packet 
50 of information or the control signal, if the information 
so is to be sent to a slave 14, checks which of the plurality 
of communication ports 46 it is to direct the information 
to and then directs the information to the desired one of 
the plurality 46 of ports. 

[0042] The addresses and their associated ports 
55 are uploaded into the master 1 2 upon startup of the sys- 
tem. This procedure is embedded in the software and 
such a procedure is well-known in the art. 
[0043] For example, in Figure 4, an electrocautery 
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device 18 transmits an address to the master controller 
12. The address is received at a one of a plurality of 
communication ports 46, the address is saved in the 
memory along with the associated communication port 
number. It is to be appreciated that the valid selection 
commands are stored on the transportable memory. For 
devices directly connected to the master, the language 
model may be stored in a memory in the master 12 or in 
the transportable memory. Language models are stored 
in associated slaves for devices that are directly con- 
nected to a slave 14. In this fashion, upon startup, the 
master 12 knows all devices that are connected to the 
system, as each slave sends to the master the 
addresses of each device and the name (i.e. coded 
phonemes that constitute the device) of the device. The 
names of the devices are uploaded into the master so 
that the validity of selection commands may take place 
in the master 12. However, language models for the 
validity of control commands are not transmitted to the 
master 12 as this would take much time and slow the 
control system 10 down. Therefore, the master control- 
ler 12 actually contains a subset of the grammar neces- 
sary to operate the devices in connection therewith, but 
that language model is limited to only the device names. 
The information regarding valid sequences of control 
commands (i.e. their control language model) is stored 
on each slave controller to which they are connected. Of 
course, if the device 1 4 is directly connected to the mas- 
ter, then the language model is stored at the master 12 
as described hereinabove. 

[0044] The control system 10 in accordance with 
the present invention provides a way to configure and 
reconfigure an operating room in a very simple fashion. 
Additionally, it is to be appreciated that the system 10 
provides an intuitive interface whereby a user can select 
a device to control and then subsequently control that 
device. The system checks to ensure that control com- 
mands received for a specific device are valid. 
[0045] Additionally, the system 10 requires the 
inclusion of adapters 52 placed intermediate a specific 
one of the plurality of devices 1 6 and a slave or the mas- 
ter 12. The adapters 52 transmit signals to their respec- 
tive slave 14 or master 12 indicative of the address of 
the device, and translate control signals sent from the 
controller to which they are connected to signals under- 
stood by the particular device for which they are 
intended. Such adapters are easily constructed and are 
well-known in the art. Additionally, such adapters may 
be included either in the respective slave 14 or master 
12 or attached to the particular one of the plurality of 
devices 16 itself. There is substantial advantage to 
attaching the adapters 52 to the devices 16 as then the 
devices may be attached to any port, whereas, if the 
adapters are attached interior the controller 12, 14, the 
specific device for which they were designed must be 
attached to the specific one of the plurality of communi- 
cation ports 46. 

[0046] If new devices are added to the system, or if 



improvements or upgrades are made to the system soft- 
ware, such changes may be incorporated into a PCM- 
CIA format card, such as the card that stores the user 
voice models. The card may be inserted into the same 

5 interface, however, system software may be uploaded 
into the master to make the upgrade without having to 
disassemble the master. This is accomplished by incor- 
porating a serial interface on the PCMCIA format card. 
As such, the central processor 44 additionally checks 

to upon startup whether there is a system upgrade to be 
made by checking the data being supplied by the PCM- 
CIA format card. Checking the activity of a serial inter- 
face is well known, however it is not heretofore known to 
incorporate a serial interface on a single PCMCIA for- 

7 5 mat card. Therefore, the combination is seen to be 
novel. Additionally, it is heretofore not known to incorpo- 
rate voice models on such a PCMCIA format card. 
[0047] Each of the at least one slave 1 4 is substan- 
tially similar to the master controller 1 2. And, each of the 

20 plurality of slaves 14 may include the full VCI so that 
each slave 14 can operate as a master. Alternatively, 
although not preferred, the slaves may not include the 
feature extractor, and only contain a subset of the lan- 
guage model (i.e. control commands) relating to the 

25 operation of each specific device. This is all that may be 
necessary in the slave because the slave receives from 
the master controller the specific address a command is 
to be sent and that it is in fact a command. Therefore, 
the slave only needs to check to ensure that it is a valid 

30 command for the specific device. In this fashion, devices 
may be directly connected to the master, or they may be 
connected to a slave which is in communication with the 
master 1 2. 

[0048] The system 10 may include output means 

35 including a video monitor 86 and a speaker 88. The 
speaker may be incorporated into the VCI 32 via a D/A 
converter 90 such that the system may communicate to 
the user any errors committed by the user in operating 
or selecting a specific device. Additionally, the output 

40 means may communicate system errors or the malfunc- 
tion of a specific device. Such information is included in 
each specific adapter and is specific to the device 
attached to the adapter. It is to be appreciated that such 
communications would be transmitted to the master 

45 where they would be either auditorially or visually dis- 
played. The system and controller in accordance with 
the invention may additionally include a foot controller, a 
hand controller or other well-known controllers. Each of 
these controllers may be used to control any of the 

so devices connected to the master or a slave, as is 
described in the patent application incorporated herein 
by reference. As such, the VCI may only be used to 
select certain devices, and once selected the device 
may be controlled via one of the well-known controllers. 

55 Ultimately, the flexibility of such a system can reduce 
costs and increase the safety of surgical procedures. 
[0049] Finally, the system 1 0 may include a connec- 
tion to a hospital computer network via a network gate- 
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way 500. Hospital networks are implemented in 
substnatially all hospitals and provide for electrical stor- 
age of patient records as well as scheduling and finan- 
cial information. 

[0050] The network gateway 500 is preferably a 
personal computer such as an IBM compatible, or some 
other well known personal computer running web 
browsing software such as Microsoft Internet Explorer, 
Netscape Communicator or any other known web 
browsing software. 

[0051] By connecting to the hospital network, 
patient information that is available at computer termi- 
nals in the hospital would also be made available in the 
operating room. As such, a vocabulary for accessing 
patient data must be provided to be used with the con- 
trol system. Examples of such vocabulary include the 
commands "get", "load" and "display". The data that 
may be provided includes, but is not limited to x-rays, 
patient history, MRIs, angiography and CAT scans. 2. 
[0052] Through the use of a web browser, the 20 
patient data may be sent to the gateway 500 in a format 
to be displayed by either a monitor 51 0 connected to the 
gateway or directly to the monitor. This would be accom- 3. 
plished through electrical connections already dis- 
closed hereinabove. 25 
[0053] To effectuate the display of patient data in a 
web browsable format, essentially HTML or some other 
well known web format, the data must be provided to the 
gateway 500 in such. An access port, essentially con- 
sisting of a URL provides a location for the web broswer 30 
to obtain patient information. This UURL provides an 
interface into the hospital network. 
[0054] Accessing of patient information is well 
known, however the reformatting of such information 
into an HTML document is new. Because HTML format- 35 
ting is well known the specifics of such formatting will 
not be disclosed herein. In this fashion, patient data may 
be accessed via voice commands and displayed on a 
monitor or a display coupled to the gateway 500. 
[0055] While certain exemplary embodiments of the 40 
present invention have been described and shown on 
the accompanying drawings, it is to be understood that 
such embodiments are merely illustrative of and not 
restrictive on the broad invention, and that this invention 
not be limited to the specific constructions and arrange- 45 
ments shown and described, since various other modi- 
fications may occur to those ordinarily skilled in the art. 
As such, what is claimed is: 

Claims so 



a) means for receiving selection com- 
mands from a user wherein each selection 
command is associated with a device in 
electrical communication with the master 
controller; 

b) means for receiving control commands 
from a user; 

c) means for converting selection com- 
mands and control commands into corre- 
sponding selection signals and control 
signals; 

d) means for routing control signals to a 
device specified by a selection command 
received by the means for receiving selec- 
tion commands, the means for routing con- 
trol signals additionally comprising means 
for receiving selection signals. 

The control system of Claim 1 further including at 
least one slave controller in electrical communica- 
tion with the master controller. 

The control system of claim 1 wherein the master 
further comprises: 

a) a microphone configured to receive voice 
commands; 

b) an A/D converter configured to convert voice 
commands into digital representations thereof; 

c) a feature extractor electrically connected to 
and in communication with the A/D converter; 

d) a decoder in electrical communication with 
the feature extractor, the decoder configured to 
generate information packages indicative of 
control commands received at the feature 
extractor; 

e) a memory in electrical communication with 
the decoder wherein the memory contains user 
models indicative of specific words that are 
used to control the system; 

f) a central processor comprising: 

1) means for routing information generated 
by the decoder to a specifically addressed 
device; 



A control system for selecting from and controlling a 
plurality of devices in an operating room, the control 
system comprising: 

a master controller, the master controller com- 
prising: 



55 



2) a memory containing addresses for 
each medical device in electrical communi- 
cation with the master controller. 

The system of claim 3 wherein the master controller 
includes a PCMCIA card interface. 
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5. The system of Claim 4 wherein user models are 
contained on a PCMCIA card that may be inserted 
into the PCMCIA card interface. 

6. The system of Claim 2 wherein the slave controller 5 
comprises means for modeling the sequence of 
valid commands. 

7. The system of Claim 6 further including a plurality 

of adapters corresponding to the number of devices io 
in electrical communication with the master control- 
ler, wherein each adapter has an associated 
address and means for converting control signals 
into signals recognized by each specific device. 

15 

8. The system of Claim 1 wherein the plurality of 
devices comprises medical devices. 

9. The system of Claim 3 wherein the master control- 
ler comprises removable storage media. 20 



25 



30 



35 



AO 



45 



50 



55 



QMcrv-Y^m- ,pp 



1068837A1 I > 



EP 1 068 837 A1 



■ 



34 



£7G J 



45- ^|) 



i! 



n 




45 



J4 




45 



45, 



24 



i 



^ 46 

r\ 

500 




n 

25 



NETWORK 
GATEWAY 



display] 



■510 



FIG. 2 

36 38 " 40- 

\' VOICE CONTROL INTERFACE 
■ATIJRF 



I RECOGNIZED \ 
I WORDS | 
I (COMMANDS) I 




/ V. 



| V MICROPHONE/^. 
\ SPEECH \ 

34 



I 

7 
I 

. 1 . 

| MEL'CEPSTRUM | 

I REPRESENTATION I 

I OF THE SPEECH I 
i i 



10 



BNSDOCIDl <EP 1068837A1_I_> 



EP 1 068 837 A1 




11 



BNSDOCID: <EP. 



1068837A1J_> 



EP 1 068 837 A1 




BNSDOCID: <EP 1068837 A 1_l_> 



EP 1 068 837 A1 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Numb* 

EP 00 30 5831 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indication, where appropriate, 
of relevant passages 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION (IM.C1.7) 



WO 99 21165 A (COMPUTER MOTION INC) 
29 April 1999 (1999-04-29) 
* abstract; claims 1-9 * 



1-9 



A61B17/00 
610L15/26 
606F19/00 



The present search report has been drawn up for ail claims 



TECHNICAL FIELDS 
SEARCHED <lnt.C*.7> 



A61B 

G10L 
G06F 



THE HAGUE 



6 November 2000 



Moers, R 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant 0 taken alone 

Y : particularly relevant 4 combined with another 

oocument of the urn category 
A " technological background 
O : noo-wrttten diectoeure 
P : intermediate document 



T : theory or prlnc^te underlying the Invention 
E : earlier patent document, but pubftahed on, c 

after the filing date 
D : document cited In the application 
L : document cited for other reaaone 



A : member of the eeme patent family, correspond! rtg 
document 



13 



8NSDOCID: <EP 1 068837 A 1J_> 



EP 1 068 837 A1 



ANNEX TO THE EUROPEAN SEARCH REPORT 
ON EUROPEAN PATENT APPLICATION NO. 



EP 00 30 5831 



This annex lists the patent family members relating to the patent documents cited in the above-mentioned European search report 
The members are as contained in the European Patent Office EDP fHe on 

The European Patent Office is in no way liable tor these particulars which are merely given for me purpose of information. 

06-11-2000 



Patent document 


Publication 




Patent family 


Publication 


cited in search report 


date 




member(s) 


date 


W0 9921165 A 


29-04-1999 


AU 


4905197 A 


10-05-1999 




EP 


1031137 A 


30-08-2000 



§ For more details about mis annex : see Official Journal of the European Patent Office, No. 12/82 



14 



BNSDOCID: <EP 1068837A1_I_> 



